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Investigative Data Warehouse flDW) - 
System Security Plan 

INTRODTJCTTON 

%e Federal Bur^u of Investigation’s (FBI) Investigative Data Warehouse (IDW-S) is an 
initial data warehouse, content management and data mining system that will permit FBI 
investigative, anal^ical. administrative and intelligence personnel to access aggregated 
ate previously only available through individual applications. The IDW-S system will be 

Et^eTn^Jn^^^^ Counter-Te^orism/Collaboration Operational 



Outside the Scope 


Date processed by the system will include the following data sets: 


• Approved case files from the FBI’s Automated Case Support (ACS) case 

management system; ^ 

* of die Joint Intelligence Committee Investigation 
(.JlCl) defined archived documents; 
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• Secure Automated Messaging Network (SAMNet) message traffic; 

• IntelPIus File Rooms; and 

• Violent Gang and Terrorist Organization File (VGTOF”) from the 
Criminal Justice Information Systems (CJIS) Division; 


• Defense Advanced Research Projects Agency (DARPA) Translingual 
Information Detection, Extraction and Summarization (TIDES) Open 
Source Data 
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Data Sources 

roW-S contains data from the following data sources with security classification indicated 
in brackets: 

• Automated Case Support (ACS) System, Electronic Case File (ECF) 
Subsystem [Secret and below] 

• IntelPlus [Secret and below] 

• Secure Automated Message Network - Secret (SAMNet-S) [Secret and 
below] 

• NCIC Violent Gang and Terrorist Offender File (VGTOF) [Sensitive But 
Unclassified] 

• Joint Intelligence Committee Investigation (JICI) [Secret and below] 

• DARPA/nDES Open Source News [Unclassified] 

Data from each source is held in an identified source Library against which users can direct 
the analytical tools. 

Data Ingest 

IDW-S receives data from sources by FTP over FBINet 
SAMNet) and CD-ROM A^GTOF. Open Source News)j 




'H Deleted: SAMNet 


Data is received by the Ingest Subsystem 


- Received data is parsed into individual serial records (in the case of ACS 
ECF), documents (IntelPlus, JICI, Open Source News), messages 
(SAMNet), or files (VGTOF). 



Outside the Scope 
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Outside the Scope 


3.5. Data Processed 


IDW-S processes the following data: 

3.5.1 ACSECF 

IDW-S contains a subset of the ECF (Electronic Case File) subsystem of the 
Automated Case System (ACS). This subset consists of serials in those case 
classifications/sub classifications that have been officially sanctioned for inclusion 
in now. For each such serial, the ECF data includes metadata and text. IDW-S is 
synchronized against the ECF system once a day, a process which consists of 
receiving and processing the previous day’s increment of ADD. MOD. and 
DELETE records.] ^ ^ 


3.5.2 IntelFlus 


Outside the Scope 


IDW-S currently contains several IntelPlus counter-terrorism (CT) Filerooms: 


b2 

b7E 
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3.5.3 SAMNet 


b2 

b7E 


b2 

b7E 


The Secure Automated Messaging Network fSAMNet) data source consists of cable 
traffic messages received by the FBIJ 

J SAMNet provides only ADD record 

types, and SAMNet data is updated in IDW-S three times a day. SAMNet data is 


3.5.4 VGTOF ' b2 

Id V 

Violent Gang Terrorist Offender File (VGTOF) data is provided by the FBI 
National Crime Information Center (NCIC). VGTOF data includes two 
components: Data/metadata for each named individual/offender and potentially 
multiple JPEG images per individual.l 1 
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3.5.5 JICI 


The Joint Intelligence Committee Investigation (JICI) data collection was created following 
the September 1 1 attacks. Paper counter-terrorism files/folders from all FBI Field Offices 




paateaj 


s 


I JICI is a static collection that 

1 


3.5.6 Open Source News 


The IDW-S VI. 0 system contains an Open Source News library collected by the 
DARPA TIDES Program. These are primarily news source from around the world 
that are either in English or have been translated into English. Op en Source News 
data is r^ eived in the form of text files (one per news article) and | 

I I r he Open Source News data goes into IDW-S once a day. Open Source 

News daXi 

Open Source News material is derived from the following sources: 

Addis Ababa Tribune - http://www.addistribune.com/ 

Agenda Brasilia - http://www.radiobras.gov.br/ 

Al-Ahram (Egypt, weekly English version) - http://weekly.ahram.org.eg/ 

AllAfrica.com - http://allafHca.com/ 

Arabic News - http://www.arabicnews.com/ansub/ 

Asahi Shimbun - http://www.asahi.com/english/ 

Asia Times (Hong Kong) - http://www.atimes.com/ 

Bangkok Post - http://www.bangkokpost.nef/ 

.Christian Science Monitor - http://www.csmonitor.com/ 

Crescent International - http://www.muslimedla.com/mainpage.htm 
Daily Telegraph (London, England) - http://news.telegraph.co.uk/ 

Dawn (Karachi, Pakistan) - http://www.dawn.com/ 

Debka (Israel) - http://www.debka.com 

East Africa Daily Nation - www.nationaudio.com/News/DailyNation/Today/ 

Gulf News (UAE) - http://www.gulf-news.com/ 

Ha'aretz (Israel) - http://www.haaretzdaily.com/ 

I IFRC international Fedgi^^^^ - ht^://www.ifrc.org/ 

IRIN Integrated Regional Information Network - littpi/Avww.irinnews.or^ 

Iraq Press News Agency - http://www.iraqpress.org/ 


b2 

b7E 


b2 

b7 


Deleted; Iniemation 


-24- 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


Investigative Data Warehouse (BDW) - Secret 
I System Security Plan 

3,December2003 

— — — Version 0.6 

Islamic Republic News Agency (Iran) - http://www.ima.com/en 
Jakarta Post - http://www.thejakartapost.com/ 

Janes - http://www.janes.com/ 

Jordan Times - http://www.jordantimes.com/ 

L Osservatore Romano - www.vatican.va/news_services/or/or_eng/text.html 
Lagos (Nigeria) Guardian - http://www.guardiannewsngr.com/ 

Lahore (Pakistan) Nation - http://www.nation.com.pk/ 

Lebanon Daily Star (Beirut) - httpV/www.dailystar.com.lb/ 

Malaysian Star - http://thestar.com.my/ 

Manila Bulletin - http://www.mb.com.ph/ 

Manila Times - http://www.manilatimes.net/ 

Miami Herald - http://www.miami.com/ 

Moscow Times - http://www.themoscovrtimes.com/ 

National Post and CP - http://www.canada.com/ 

New Straits Times (Kuala Lumpur) - http://www.emedia.com.my/Current_News/NST/ 

PETRA (Jordanian News Agency) - http://www.petra.gov.jo 
Pakistan Observer (Islamabad) - http://pakobserver.net/ 

Palestine Chronicle - http://palestinechronicle.com/ 

People's Daily (China) - http://english.peopledaily.com.cn/ 

Philippine Star - http://vvww.philstar.com/philstar/ 

Pravda - http://english.pravda.ru/ 

ProMed - epidemiology mailing list 

Russian Information Agency Novosti - http://en.rian.ru/ 

Russian Issues (Misc. Russian news) - http://www.therussianissues.com/ 

Russian Observer - http://www.russianobserver.com/ 

SABA (The News Agency of Yemen) - http://www.sabanews.gov.ye 
Saudi Gazette - http://www.saudigazette.com.sa/sgazette/ 

South African Dispatch - http://www.dispatch.co.za/ 

Sydney Morning Herald - http://www.smh.com.au 
Tehran Times - http://www.tehrantimes.com/ 

Times of India - http://timesofindia.indiatimes.com/cms.dll 
UNHCR UN High Commissioner on Refugees - http://www.unhcr.ch/ 

Ummah News - http://www.ummahnews.com/ 

Uzbekistan Report - http://www.uzreport.com/eng/ 

Washington Post - http://www.washingtonpost.com/ 

XinHua News Service - http://www.xinhuanet.com/english/ 

Yemen Times (weekly) - http://www.yementimes.com/ 

Yomiuri Shimbun (Japan) - http://www.yomiuri.co.jp/ 
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3.5.7 Summary of Data Sources 




isaiiiB*® 

ACS 

FBI Automated Case 
System (ACS) 

FTP 

IntelPlus 

FBI Intel Plus 

FTP 

SAMNet 

FBI Secure Automated 
Messaging Network 
(SAMNet) 

FTP 

VGTOF 

FBI National Crime 
Information Center tNCIO 

CD-ROM 

JICI 

FBI Records Management 
Division (RMD), 
Ooeument Laboratory 
(DocLab), FBIHQ 

Multiple 

Open 

Source 

News 

Translingual Information 
Detection, Extraction and 
Summarization (TIDES) 
•’rogram. Defense Advanced 
Research Projects Agency 
(DARPA) 

CD-ROM ' 


b2 

b7E 
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3.9.9 Indirect Connections 

IDW-S connects lo the followina soui’ces of dala: 


Outside the Scope 






1 

FRI AuUinialud 

Sccrel 

FBI 

FTP 


Case .System (ACS') 


l-UI Intel Plus 

■Secret 

FBI 

FTP 
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b7E 
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